Effects of conversation content on viewing dyadic conversations

People typically follow conversations closely with their gaze. We asked whether this viewing is influenced by what is actually said in the conversation and by the viewer’s psychological condition. We recorded the eye movements of healthy (N = 16) and depressed (N = 25) participants while they were viewing video clips. Each video showed two people, each speaking one line of dialogue about socio-emotionally important (i.e., personal) or unimportant topics (matter-of-fact). Between the spoken lines, the viewers made more saccadic shifts between the discussants, and looked more at the second speaker, in personal vs. matter-of-fact conversations. Higher depression scores were correlated with less looking at the currently speaking discussant. We conclude that subtle social attention dynamics can be detected from eye movements and that these dynamics are sensitive to the observer’s psychological condition, such as depression

Co-registration of eye movements and fixation-related potentials in natural reading: Practical issues of experimental design and data analysis

A growing number of studies are using co-registration of eye movement (EM) and fixation-related potential (FRP) measures to investigate reading. However, the number of co-registration experiments remains small when compared to the number of studies in the literature conducted with EMs and event-related potentials (ERPs) alone. One reason for this is the complexity of the experimental design and data analyses. The present paper is designed to support researchers who might have expertise in conducting reading experiments with EM or ERP techniques and are wishing to take their first steps towards co-registration research. The objective of this paper is threefold. First, to provide an overview of the issues that such researchers would face. Second, to provide a critical overview of the methodological approaches available to date to deal with these issues. Third, to offer an example pipeline and a full set of scripts for data preprocessing that may be adopted and adapted for one's own needs. The data preprocessing steps are based on EM data parsing via Data Viewer (SR Research), and the provided scripts are written in Matlab and R. Ultimately, with this paper we hope to encourage other researchers to run co-registration experiments to study reading and human cognition more generally

Parafoveal Previews and Lexical Frequency in Natural Reading: Evidence from Eye Movements and Fixation-Related Potentials

Participants’ eye movements and EEG signal were recorded as they read sentences displayed according to the gaze-contingent boundary paradigm. Two target words in each sentence were manipulated for lexical frequency (high vs. low frequency) and parafoveal preview of each target word (identical vs. string of random letters vs. string of Xs). Eye movement data revealed visual parafoveal-on-foveal effects (POF), as well as foveal visual and orthographic preview effects and word frequency effects. Fixation-related potentials (FRPs) showed visual and orthographic PoF effects as well as foveal visual and orthographic preview effects. Our results replicated the early preview positivity effect (Dimigen et al., 2012) in the X-string preview condition, and revealed different neural correlates associated with a preview comprised of a string of random letters relative to a string of Xs. The former effects seem likely to reflect difficulty associated with the integration of parafoveal and foveal information, as well as feature overlap, while the latter reflect inhibition, and potentially disruption, to processing underlying reading. Interestingly, and consistent with Kretzschmar, Schlesewsky and Staub (2015), no frequency effect was reflected in the FRP measures. The findings provide insight into the neural correlates of parafoveal processing and written word recognition in reading and demonstrate the value of utilising ecologically valid paradigms to study well established phenomena that occur as text is read naturally

A dynamic adjustment model of saccade lengths in reading for word-spaced orthographies: evidence from simulations and invisible boundary experiments

Contemporary models of eye movement control in reading assume a discrete target word selection process preceding saccade length computation, while the selection itself is assumed to be driven by word identification processes. However, a potentially more parsimonious, dynamic adjustment view allows both next word length and its content (e.g. orthographic) to modulate saccade length in a continuous manner. Based on a recently proposed center-based saccade length account (a new regression model of forward saccade length is introduced and validated in a simulation study. Further, additional simulations and gaze-contingent invisible boundary experiments were used to study the cognitive mechanisms underlying skipping. Overall, the results support the plausibility of dynamic adjustment of saccade length in word-spaced orthographies. In the future, the present regression formula-based computational model will allow a straightforward implementation of influences of current and next word content (visual, orthographic, or contextual) on saccade length computation

Somatosensory Brain Function and Gray Matter Regional Volumes Differ According to Exercise History : Evidence from Monozygotic Twins

Associations between long-term physical activity and cortical function and brain structure are poorly known. Our aim was to assess whether brain functional and/or structural modulation associated with long-term physical activity is detectable using a discordant monozygotic male twin pair design. Nine monozygotic male twin pairs were carefully selected for an intrapair difference in their leisure-time physical activity of at least three years duration (mean age 34 +/- 1 years). We registered somatosensory mismatch response (SMMR) in EEG to electrical stimulation of fingers and whole brain MR images. We obtained exercise history and measured physical fitness and body composition. Equivalent electrical dipole sources of SMMR as well as gray matter (GM) voxel counts in regions of interest indicated by source analysis were evaluated. SMMR dipolar source strengths differed between active and inactive twins within twin pairs in postcentral gyrus, medial frontal gyrus and superior temporal gyrus and in anterior cingulate (AC) GM voxel counts differed similarly. Compared to active twins, their inactive twin brothers showed greater dipole strengths in short periods of the deviant-elicited SMMR and larger AC GM voxel counts. Stronger activation in early unattended cortical processing of the deviant sensory signals in inactive co-twins may imply less effective gating of somatosensory information in inactive twins compared to their active brothers. Present findings indicate that already in 30's long-term physical activity pattern is linked with specific brain indices, both in functional and structural domains.Peer reviewe

Task-oriented reading efficiency: interplay of general cognitive ability, task demands, strategies and reading fluency

The associations among readers’ cognitive skills (general cognitive ability, reading skills, and attentional functioning), task demands (easy versus difficult questions), and process measures (total fixation time on relevant and irrelevant paragraphs) was investigated to explain task-oriented reading accuracy and efficiency (number of scores in a given time unit). Structural equation modeling was applied to a large dataset collected with sixth-grade students, which included samples of dysfluent readers and those with attention difficulties. The results are in line with previous findings regarding the dominant role of general cognitive ability in the accuracy of task-oriented reading. However, efficiency in task-oriented reading was mostly explained by the shorter viewing times of both paragraph types (i.e., relevant and irrelevant), which were modestly explained by general cognitive ability and reading fluency. These findings suggest that high efficiency in task orientation is obtained by relying on a selective reading strategy when reading both irrelevant and relevant paragraphs. The selective reading strategy seems to be specifically learned, and this potentially applies to most students, even those with low cognitive abilities

Effects of Conversation Content on Viewing Dyadic Conversations

People typically follow conversations closely with their gaze. We asked whether this viewing is influenced by what is actually said in the conversation and by the viewer's psychological condition. We recorded the eye movements of healthy (N = 16) and depressed (N = 25) participants while they were viewing video clips. Each video showed two people, each speaking one line of dialogue about socio-emotionally important (i.e., personal) or unimportant topics (matter-of-fact). Between the spoken lines, the viewers made more saccadic shifts between the discussants, and looked more at the second speaker, in personal vs. matter-of-fact conversations. Higher depression scores were correlated with less looking at the currently speaking discussant. We conclude that subtle social attention dynamics can be detected from eye movements and that these dynamics are sensitive to the observer's psychological condition, such as depression

Attentional bias towards interpersonal aggression in depression - an eye movement study

Depressed individuals exhibit an attentional bias towards mood-congruent stimuli, yet evidence for biased processing of threat-related information in human interaction remains scarce. Here, we tested whether an attentional bias towards interpersonally aggressive pictures over interpersonally neutral pictures could be observed to a greater extent in depressed participants than in control participants. Eye movements were recorded while the participants freely viewed visually matched interpersonally aggressive and neutral pictures, which were presented in pairs. Across the groups, participants spent more time looking at neutral pictures than at aggressive pictures, probably reflecting avoidance behavior. When the participants could anticipate the stimulus valence, depressed participants - but not controls - showed an early attentional bias towards interpersonally aggressive pictures, as indexed by their longer first fixation durations on aggressive pictures than on neutral pictures. Our results thus preliminarily suggest both an early attentional bias towards interpersonal aggression, which is present, in depressed participants, also when aggression contents are anticipated, and a later attentional avoidance of aggression. The early depression-related bias in information processing may have maladaptive effects on the way depressed individuals perceive and function in social interaction and can, therefore, maintain depressed mood

Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties

Neural correlates in reading and speech processing have been addressed extensively in the literature. While reading skills and speech perception have been shown to be associated with each other, their relationship remains debatable. In this study, we investigated reading skills, speech perception, reading, and their correlates with brain source activity in auditory and visual modalities. We used high-density event-related potentials (ERPs), fixation-related potentials (FRPs), and the source reconstruction method. The analysis was conducted on 12–13-year-old schoolchildren who had different reading levels. Brain ERP source indices were computed from frequently repeated Finnish speech stimuli presented in an auditory oddball paradigm. Brain FRP source indices were also computed for words within sentences presented in a reading task. The results showed significant correlations between speech ERP sources and reading scores at the P100 (P1) time range in the left hemisphere and the N250 time range in both hemispheres, and a weaker correlation for visual word processing N170 FRP source(s) in the posterior occipital areas, in the vicinity of the visual word form areas (VWFA). Furthermore, significant brain-to-brain correlations were found between the two modalities, where the speech brain sources of the P1 and N250 responses correlated with the reading N170 response. The results suggest that speech processes are linked to reading fluency and that brain activations to speech are linked to visual brain processes of reading. These results indicate that a relationship between language and reading systems is present even after several years of exposure to print

A co-registration investigation of inter-word spacing and parafoveal preview: Eye movements and fixation-related potentials

Participants’ eye movements (EMs) and EEG signal were simultaneously recorded to examine foveal and parafoveal processing during sentence reading. All the words in the sentence were manipulated for inter-word spacing (intact spaces vs. spaces replaced by a random letter) and parafoveal preview (identical preview vs. random letter string preview). We observed disruption for unspaced text and invalid preview conditions in both EMs and fixation-related potentials (FRPs). Unspaced and invalid preview conditions received longer reading times than spaced and valid preview conditions. In addition, the FRP data showed that unspaced previews disrupted reading in earlier time windows of analysis, compared to string preview conditions. Moreover, the effect of parafoveal preview was greater for spaced relative to unspaced conditions, in both EMs and FRPs. These findings replicate well-established preview effects, provide novel insight into the neural correlates of reading with and without inter-word spacing and suggest that spatial selection precedes lexical processing